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CLAIMS: 

1 . A link generation process executed by a computer system, including: 

processing data files of a network site to identify valid parameters for generating 
5 dynamically generated content of said network site; and 

generating encoded links for accessing said dynamically generated content, said 
encoded links including said parameters and being in a form suitable for an indexing 
agent to allow indexing of said dynamically generated content. 

10 2. A process as claimed in claim 1, wherein said generating includes generating a table of 
contents for content of said network site, said table of contents including said encoded 
links. 

3. A process as claimed in claim 2, wherein said table of contents includes links to static 
1 5 content of said network site. 

4. A process as claimed in claim 2, wherein said table of contents includes one or more 
pages, at least one of said pages including one or more links to content of said network 
site. 

20 

5. A process as claimed in claim 2, wherein said table of contents includes a plurality of 
pages, each of said pages including one or more links to respective others of said 
pages, at least one of said pages including one or more links to content of said network 
site* 

25 

6. A process as claimed in claim S, wherein links in said table of contents pages are 
arranged as a hierarchy corresponding to content of said network site. 

7. A process as claimed in claim 2, including generating a link to a table of contents page 
30 for a script for djrnamically generating content on the basis of supplied parameters, 
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wherein said table of contents page for said script includes a plurality of encoded links 
corresponding to respective parameters for said script. 

8. A process as claimed in claim 7, \\iierein the table of contents page for said script 
5 includes a plurality of encoded links corresponding to respective combinations of 

parameters and parameter values for said script. 

9. A process as claimed in claim 7, v^erein the table of contents page for said script 
includes at least one link to a further table of contents page including links 

10 corresponding to respective parameters or parameter values for said script and 
including at least one common parameter or parameter value. 

10. A process as claimed in claim 1, wherein said data files include at least one of web 
server configuration files, scripts, and database tables. 

15 

1 1 . A process as claimed in claim 1 , wherein said processing includes processing scripts of 
said network site to identify valid database query parameters on the basis of structured 
query language statemmts of said scripts. 

20 12. A process as claimed in claim 1, wherein said processing includes processing said data 
files to identify valid combinations of database query parameters and values for 
generating said dynamically generated content. 

13. A process as claimed in claim 12, wherein said processing includes processing 
25 database tables associated with said network site to identify said valid combinations of 

database query parameters and values. 

14. A process as claimed in claim 1, wherein said encoded links are encoded as links to 
static content. 

30 
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15. A process as claimed in claim 1, wherein each of said encoded links includes a suffix 
that indicates a type of dynamically generated content for the link. 

16. A process as claimed in claioi 1, wherein said encoded links include at least one link 
5 having a prefix identifying the link as a link to a table of contents page, and at least one 

link having a prefix identifying the link as a link to content of said network site. 

17. A process as claimed in claim 1, including: 
receiving a request for content of said network site fix)m a remote agent; 
determining whether said remote agent is an indexing agent; 
sending a table of contents page to said remote agent if said remote agent is an 

indexing agen^ and 

sending the requested content to said remote agent if said remote agent is not an 
indexing agent. 

1 8. A process as claimed in claim 1, y^erein said encoded links are also URI-encoded. 

19. A process as claimed in claim 1, wherein said processing includes processing said data 
files to identify all servable static content of said netwoA site and all servable 

20 dynamically generated content of said network site; and wherein said generating 
includes generating links to said servable static content and said servable dynamically 
generated content to provide a table of contents for all servable content of said network 
site. 

25 20. A process as claimed in claim 1, including processing scripts of said network site to 
detennine request data for retrieving said dynamically generated data; wherein said 
encoded links are generated on the basis of said request data and said parameters. 



10 
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21. A process as claimed in claim 20, wherein said step of processing scripts includes 
processing said scripts to determine access data for accessing a database of said 
network site to generate said dynamically generated content. 

5 22. A process as claimed in claim 1, wherein said steps of processing and generating are 
executed at periodic intervals. 

23. A process as claimed in claim 1 , wherein said steps of processing and generating are 
executed in response to receiving a request for content of said network site. 

10 

24. A process as claimed in claim 1 , including receiving a request generated in response to 
selecting one of said encoded links, translating said request, and forwarding the 
translated request to said network site to access corresponding dynamically generated 
content of said network site. 

15 

25. A process as claimed in claim 24, wherein said translated request is an HTTP GET 
request. 

26. A process as claimed in claim 24, wherein said translated request is an HTTP POST 
20 request. 

27. A process as claimed in claim 1, including sending said encoded links to a remote 
indexing agent to allow said dynamically generated data to be indexed. 

25 28. A {process as claimed in claim 1, including sending said encoded links to a remote 
system using one of HTTP PUT, HTTP POST, FTP, and SMTP. 

29. A process as clamied in claim 5, wherein all servable data of said network site can be 
accessed via selection of any one of the links to said pages. 

30 
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SO. A process as claimed in claim 1, wherein said table of contents is generated in one of 
HTML, XML, HCL, and sitelisttxt formats. 

31. A link generation process executed by a computer system, including generating at least 
5 one encoded Mnk for retrieving dynamic content data of a hierarchical data set in 
response to selecting said at least one encoded link, said at least one encoded link 
including one or more parameters for generating said dynamic content data and being 
in a form suitable for an indexing agent to allow indexing of said dynamic content data. 

10 32. A link gen^ation process as claimed in claim 3 1, including generating a list of links to 
content data of at least one node of said hierarchical data set, said links mchiding said 
at least one CTCoded link. 

33. A link generation process as claimed in claim 32, wheiein said generating includes 
1 5 generating links to all available data of said hierarchical data set. 

34. A link generation process as claimed in claim 32, wherein said links include one or 
more direct links to content data of said hierarchical data set. 

20 35. A link generation process as claimed in claim 32, wherein said links include one or 
more indirect links to content data of said hierarchical data set 

36. A link generation process as claimed in claim 32, wherein said links include at least 
one of a direct and an indirect link to content data of said node. 

25 

37. A link generation process as claimed in claim 32, lAiierein said list of Imks corresponds 
to a node of said hierarchical data set 

38. A link generation process as claimed in claim 32, wherein said hierarchical data set 
30 includes at least one web site. 
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39. A link generation process as claimed in claim 31, wherein said at least one encoded 
link includes at least one encoded POST query. 

5 40. A link generation process as claimed in claim 31, >^erein said at least one encoded 
link includes at least one encoded GET query. 

41. A link generation process, including: 

generating encoded links for dynamic content of a network site, each of said 
10 encoded links including one or more parameters for use in generating said dynamic content 
and being in a form suitable for an indexing agent to allow indexing of said dynamic 
content; 

receiving requests from an indexing agent for content of said site; and 
responding to said requests with said encoded links and said dynamic content 
IS correspondixi^ ftereto for indexing. 

42. A process as claimed in claim 41, wherein said links are generated as one or more of 
hyperlinks, XML elements, and text. 

20 43. A link generation system having components for executing the steps of any one of 
claims 1 to 42. 

44. A computer readable storage medium having stored thereon program code for 
executing the steps of any one of claims 1 to 42. 

25 

45. A link generation system, including: 

a content discovery module for processing data files of a network site to identify 
servable data and parameters for generating dynamicaDy generated content of said 
servable data; and 
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a link generator for generating links to said servable data to allow said servable 
content to be accessed using said links, said links including encoded links for accessing 
said dynamically generated content, said encoded links including said parameters and 
being in a form suitable for an indexing agent to allow indexing of said dynamically 
5 generated content. 

46. A link generation system as claimed in claim 45, wherein said link generator is adapted 
to process a database of said network site to determine said parameters. 

10 47. A link generation system as claimed in claim 45, including a proxy server for receiving 
a request generated in response to selecting one of said encoded links, translating said 
request, and forwarding the translated request to said network site to access 
corresponding dynamically generated data of said network site. 

15 48. A link generation system, including: 

one or more content discovery modules for processing data files of respective 
network servers to identify servable data and parameters for generating dynamically 
generated content of said servable data; and 

a link generator for generating links to said servable data to allow said servable 
20 content to be accessed using said links, said links including encoded links for 
accessing said dynamically generated content, said encoded links including said 
parameters and being in a form suitable for an indexing agent to allow indexing of said 
dynamically generated content. 

25 
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